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Abstract 

This  thesis  presents  an  algorithm  for  detecting  man¬ 
made  objects  embedded  in  low  resolution  imagery.  A  modified 
Kirsch  edge  operator  is  used  for  initial  image  enhancing. 

A  normal  Kirsch  operator  is  then  used  for  edge  detection. 

A  two-dimensional  threshold  for  edges  and  the  original 
intensity  detects  the  pixels  on  the  edges  of  the  objects 
only.  These  pixels  are  then  subjected  to  connectedness  and 
size  tests  to  detect  the  blobs  which  most  probably  represent 
man-made  objects.  The  algorithm  was  tried  on  325  pictures 
and  a  detection  probability  of  83.3%  was  achieved.  False 
alarm  probability  was  less  than  10%. 
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I.  INTRODUCTION 


Importance 

Military  applications  for  locating  man-made  objects  in 
low  resolution  imagery  are  commonly  referred  to  as  "target 
cueing"  (Ref  1) . 

Recent  advances  in  image  sensor  technology  have  increased 
the  sensitivity  and  field  of  view  of  imaging  systems  signi¬ 
ficantly.  This  is  particularly  true  in  the  infrared  wavelength 
region  with  the  development  of  high  quality  infrared  sensors. 
Because  of  this,  the  amount  of  information  presented  to  the 
operator  of  such  imaging  systems  has  increased  manyfold  over 
previous  systems  and  the  operator  is  burdened  with  a  high  task 
load  in  attempting  to  analyze  scene  content.  Tasks  involving 
the  detection  and  recognition  of  man-made  objects  (targets) 
become  inefficient  and  inaccurate  as  the  time  available  for 
this  task  becomes  short  or  as  the  environment  surrounding  this 
task  load  becomes  complicated. 

Automatic  machine  detection  and  recognition  of  man-made 
objects  is  now  viable  with  recent  advances  in  electronic 
technology.  Some  of  these  include  high-density  digital 
memories,  CCD  analog  signal  processing  components,  advances 
in  pattern  recognition  techniques,  and  the  availability  of 
high  quality  IR  sensors.  The  area  of  automatic  FLIR  target 
cueing  has  received  much  attention  recently.  Results  indicate 


that  the  performance  achievable  with  automatic  target  cuers 
can  be  better  than  human  performance  under  similar  time  and 
environmental  constraints. 

The  problem  of  pattern  classification,  as  classically 
defined,  aims  at  analytical  techniques  by  which  a  given  object 
can  be  correctly  assigned  into  one  of  several  pre-specified 
categories.  Various  approaches  have  been  under  active  inves¬ 
tigation  for  many  years,  and  several  representative  results 
can  be  found  in  readily  available  literature  (Refs  2-4) .  All 
pattern  classification  techniques  developed  to  date  are  predi¬ 
cated  for  optimal  performance  upon  the  availability  as  input 
to  the  classifier  of  a  "well-defined  test  pattern  clearly 
devoid  of  any  extraneous  components  irrelevant  to  the  classi¬ 
fication  task"  (Ref  12). 

.  A  "well-defined  pattern"  implies  a  high  resolution  image 
containing  all  the  textural  features  of  the  target.  With  the 
IR  sensors  available  today,  the  required  resolution  is  achiev¬ 
able  only  at  close  ranges  from  the  targets.  In  a  real  combat 
situation,  this  closeness  may  be  fatal.  From  a  tactically 
advantageous  distance,  the  resolution  is  not  high  enough  to 
present  a  "well-defined  test  pattern"  to  a  classifier. 

Therefore,  within  the  context  of  "real"  imagery i  a 
natural  question  arises  as  to  how  one  can  localize  a  candidate 
object  in  a  given  image  and,  following  such  an  operation,  how 
does  one  extract  it  from  its  surrounding  background  so  that 
as  ideal  a  pattern  as  possible  is  presented  to  the  classifier 


designed  to  yield  its  identity.  Implicit  in  this  statement 
is  the  partitioning  of  pattern  classification  task  into  three 
phases.  First,  a  scene  is  scanned  for  localization  of  possible 
candidate  targets;  second,  each  object  is  extracted  from  its 
immediate  environment;  and  third,  the  raw  or  feature  summarized 
object  is  preprocessed  through  the  classifier  for  final 
identification. 

This  thesis  report  deals  with  the  first  two  phases  of  the 
pattern  classification  problem,  as  described  above. 

Background 

FLIR  sensors  detect  radiation  of  wavelengths  in  3-5  or 
8-14  micrometer  atmospheric  windows  and  derive  their  images 
from  the  variations  in  their  field  of  view  of  the  IR  radiation 
received.  These  variations  can  be  due  either  to  variations 
in  the  emittance  of  the  scene  or  to  variations  in  the  radia¬ 
tion  reflected  from  the  scene.  The  radiation  reflected  from 
the  scene  can  be  caused  by  a  variety  of  natural  sources  such 
as  clouds,  sky,  and  background.  But  the  radiation  reflected 
is  usually  less  than  that  associated  with  a  target  at  ambient 
temperature.  The  primary  scene  signal  results  from  variations 
in  emittance  and  may  be  due  to  variations  in  temperature  or 
emissivity.  That  is,  the  scene  is  the  source  generating  most 
of  the  radiation  itself  because  its  inherent  temperature 
differ  - . 

T',  3  process  of  pattern  recognition  usually  involves  a 
sequei.ce  of  operations  including  preprocessing,  feature 
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extraction  and  classification.  Preprocessing  operations  are 
sometimes  applied  to  correct  for  known  geometric  distortions, 
to  filter  out  redundant  data  to  enhance  information  contents 
of  the  scene,  and  to  transform  the  data  to  make  it  easier  to 
extract  features.  These  features  are  used  to  further  discard 
false  alarms,  if  any,  and  classify  the  objects  if  target 
classification  is  desired. 

The  derivation  of  a  useful  set  of  features  is  the  most 
critical  part  of  the  solution  of  pattern  recognition  problems. 
Like  visible  scenes,  thermal  scenes  also  have  infinite 
variety.  The  choice  of  features  for  a  given  problem,  at 
present,  is  largely  ad  hoc.  Feature  definition,  therefore, 
is  strongly  dependent  upon  the  application  and  the  kind  of 
preprocessing  operations  performed.  Satisfactory  solutions 
to  difficult  problems  seem  to  require  considerable  study  and 
experimentation  with  large  amounts  of  representative  data  and 
a  thorough  understanding  of  the  underlying  physical  phenomena 
which  dictate  the  empirically  observable  class  variations. 
Moreover,  the  tools  of  the  analyst  often  determine  the  ease 
with  which  a  solution  is  obtained  and  probably  the  nature  of 
the  solution  as  well. 

The  essence  of  the  problem  is  that,  at  present,  there  is 
no  mathematical  model  or  basis  which  could  usefully  represent 
the  infinite  variety  of  thermal  scenes  in  nature,  as  a  whole 
or  in  parts.  Therefore,  it  is  the  intuition  and  the  judgment 
of  the  individual,  rather  than  any  underlying  theory,  which 
determines  the  operations  performed  and  features  analyzed  for 
picture  processii\g. 
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Purpose 


The  purpose  of  this  study  was  to  devise  a  combination  and 
sequence  of  operations  for  a  specific  set  of  IR  pictures  so 
as  to  achieve  the  best  possible  results.  The  merit  of  the 
results  was  based  on  two  criteria;  maximum  detection  probabil¬ 
ity  and  minimum  false  alarm  probability.  Maximization  of 
detection  probability  was  given  preference  over  minimization 
of  false  alarm  probability.  The  motivation  for  this  preference 
was  twofold.  First,  the  results  of  a  target  cuer  are  not  used 
to  make  the  final  decision;  rather,  they  are  an  aid  to  the 
final  decision-making  process.  Therefore,  it  is  more  important 
to  detect  all  the  targets  than  to  detect  only  the  targets. 
Secondly,  the  false  alarm  probability  can  be  minimized  to  a 
great  extent  if  the  ratio  of  the  actual  target  size  to  that 
of  the  pictured  target  is  known.  This  ratio,  besides  other 
factors,  is  dependent  upon  the  characteristics  of  the  sensor. 
Access  to  the  sensor  and  its  characteristics  was  not  provided 
because  of  security  reasons. 

Scope 

The  algorithms  in  this  thesis  were  only  tested  on  data 
provided  by  Eglin  Air  Force  Base,  Florida.  Therefore,  the 
whole  process  was  structured  to  provide  the  best  possible 
results  for  that  data.  The  performance  of  the  algorithms 
on  any  other  data  is  not  known. 


The  computation  time  required  by  the  process  is  an 
important  operational  consideration.  Not  only  accuracy, 
but  accuracy  with  speed  is  required  in  actual  hardware. 
Computer  programs  for  this  thesis,  however,  were  not  opti¬ 
mized  with  regard  to  running  time  or  number  of  operations 
required  because  of  academic  time  limitations.  The  nature 
of  the  calculations  used  by  the  algorithm  do  not  seem  to 
suggest  any  difficulty  in  practical  implementation,  and  it 
is  anticipated  that  a  dedicated  chip  implementation  should 
be  capable  of  running  in  real  time. 
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II.  PREPROCESSING 


Introduction 

In  digital  picture  processing,  a  picture  is  represented 
by  a  matrix  of  certain  dimensions.  Each  element  of  the 
matrix,  shown  as  a  point  on  the  picture,  represents  a  certain 
area  in  the  actual  scene.  The  value  of  each  element  of  the 
matrix  is  a  measure  of  the  temperature  of  the  corresponding 
area  in  the  actual  scene.  Figure  2.1(a)  shows  a  10  x  10 
matrix,  and  Figure  2.1(b)  is  a  gray  scale  representation  of 
the  same  matrix. 

Before  any  decision  is  made  as  to  whether  a  target  is 
present  or  not,  it  is  important  to  localize  the  areas  in  the 
picture  which  look  like  potential  targets.  This  process  of 
localizing  potential  targets  is  called  preprocessing.  A 
point  is  considered  to  be  a  part  of  a  potential  target  if 

i)  its  intensity  is  above  a  certain  threshold,  and 
ii)  its  contrast  with  its  surrounding  points  is 
above  a  certain  threshold. 

This  chapter  gives  the  details  of  those  operations  which 
select  only  those  points  out  of  the  picture  which  satisfy 
the  above  criteria. 
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Image  Enhancement 


The  underlying  assumption  o£  the  whole  process  is  that  the 
objects  or  the  targets  in  the  picture  appear  as  a  cluster  of 
points,  which  are  above  the  intensity  and  contrast  threshold. 

But  in  real  imagery,  it  does  not  happen  this  way.  There  are 
many  points  within  the  object  area  which  fall  below  one  of 
the  thresholds.  This  phenomenon  affects  the  picture  processing 
adversely  in  two  ways.  First,  when  looking  for  targets  as 
small  as  2  X  2  or  3  X  3,  disappearance  of  even  two  or  three 
points  from  the  target  area  tends  to  destroy  the  whole  target. 
Secondly,  a  large  piece  of  terrain  or  some  other  natural  object 
in  the  scene  as  hot  as  the  targets  tends  to  appear  divided 
into  parts  with  each  part  having  the  appearaiice  of  a  target. 
Therefore,  it  is  essential  to  enhance  the  quality  of  image  in 
the  sense  that  low  intensity  points  in  an  area  of  high  intensity 
should  be  brought  to  the  same  intensity  level. 

In  the  process  of  edge  detection,  many  edge  operators 
available  in  literature  were  tried.  One  of  the  effective 
and  interesting  edge  operators  tried  was  the  Kirsch  operator 
(Ref  5).  In  the  Kirsch  operator,  every  point,  p,  in  the  picture 
is  given  an  edge  value  according  to  the  contrast  function 


max 
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where  all  subscripts  are  evaluated  modulo  8. 
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Figure  2.2.  Numbering  of  Elements  in  the 
Neighborhood  of  an  Arbitrary 
Point,  P,  in  Kirsch  Operator 


To  study  the  effect  of  coefficients  5  and  3  on  the 
performance  of  the  operator,  each  coefficient  was  varied 
from  1  to  10,  keeping  the  other  constant.  It  was  observed 
that  the  contrast  function 


max  [1,  maxUoCaj  *  ♦  a^^P  -  Caj.j  ♦  a^,,  •  ...  a^^p 


behaved  as  an  image  enhancing  function.  Figure  2.4  is  an 
image_ enharxed  version  of  Figure  2.3.. 

The  image  enhancing  function,  also,  increases  the  size 
of  the  targets.  But  that  need  not  present  any  problem.  The 
purpose  is  to  detect  a  target  and  the  analysis  of  the  results 
shows  the  bigger  the  target,  the  better  the  detection.  So 
the  effect  of  image  enhancing  on  the  ultimate  detection 
is  especially  beneficial. 
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Figure  2-4.  Image  Enhanced  Picture 
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Edge  Detection 


Image  edges  can  be  defined  as  local  changes  or  dis¬ 
continuities  in  an  image  attribute  such  as  luminance  or 
texture  (Ref  6).  These  changes  are  important  in  the 
analysis  of  images  because  they  often  provide  an  indication 
of  the  physical  extent  of  the  objects  within  the  image. 

In  target  cueing,  the  significance  of  edges  becomes  more 
important  because,  in  the  absence  of  textural  information 
in  the  images,  edges  are  the  only  feature  which  can  be 
readily  extracted. 

There  are  many  techniques  which  can  be  used  in  edge 
detection.  These  include  simple  differential  operators, 
template  matching,  least  square  edge  fitting,  and  techniques 
based  on  statistical  detection  theory.  There  are  also  many 
heuristic  methods  developed  for  edge  detection.  Surveys 
of  edge  detection  techniques  are  readily  available  in  the 
literature  (Refs  7-10). 

For  the  purpose  of  this  thesis,  the  Robert  operator 
(Ref  11),  Sobel  Operator  (Ref  13),  and  Kirsch  operator 
(Ref  5)  were  experimented  with.  The  Kirsch  operator  was 
found  to  be  the  best  as  far  as  results  were  concerned. 

This  choice  was  based  upon  the  empirical  results  obtained 
from  processing  of  the  pictures  from  the  given  data. 

The  Kirsch  operator  assigns  an  edge  value  to  each 
point  in  the  picture  by  calculating  a  contrast  function. 
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where  all  subscripts  are  evaluated  modulo  8.  Figure  2.2 
gives  the  details  of  the  numbering  of  elements  in  the  neigh¬ 
borhood  of  an  arbitrary  point,  P.  This  non-isotropic 
contrast  function  is  related  to  the  magnitude  of  the  grad¬ 
ient  of  the  original  brightness  function.  It  is  non- 
symmetric  and  sensitive  to  small  changes  in  the  value  of 
the  gradient.  Figure  2-5  is  the  Kirsch  operated 
version  of  Figure  2-3  after  it  had  been  image  enhanced 
(Figure  2-4). 

The  Kirsch  operator  was  developed  for  the  processing 
of  biological  images  where  the  objects  to  be  detected  are 
small  biological  cells.  This  is  exactly  the  problem  in 
target  cueing.  The  targets  to  be  detected  are  at  large 
distances  and  therefore  very  small.  That  seems  to  explain 
the  better  performance  of  Kirsch  operators. 

Thresholding 

In  this  thesis,  a  target  is  defined  as  a  cluster  of 
points  having  intensity  above  a  certain  threshold  and  edge 
values  above  a  certain  threshold.  The  problem  lies  in 
selecting  the  threshold  so  that  no  target  points  are  lost 
and  no  noise  points  are  introduced.  It  is  highly  improbable 
that  a  universal  threshold  should  exist  which  will  be  a 
criterion  of  acceptance  and  rejection  of  a  point  for  all 
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pictures,  even  in  a  given  data  set.  Instead,  it  is  more 
appropriate  to  dynamically  select  a  threshold  for  every 
picture  separately.  By  trial  and  error,  a  threshold  of 
mean  plus  variance  of  a  picture  was  found  to  be  a  good 
threshold . 

The  process  calculates  the  mean  and  variance  of  the 
original  intensity  function.  The  edge  values  for  each 
point  are  calculated  using  Kirsch  contrast  function  and 
the  mean  and  variance  of  these  edge  values  are  calculated. 
Now  each  point  in  the  picture  has  two  values  associated 
with  it,  the  intensity  value  and  the  edge  value.  At  this 
stage,  each  point  is  tested  for  a  two  dimensional  threshold, 
one  each  for  the  two  values  associated  with  it.  A  point 
is  retained  as  a  constituent  of  a  target  if  its  intensity 
value  is  greater  than  mean  plus  variance  of  picture  inten¬ 
sity  and  its  edge  value  is  greater  than  mean  plus  variance 

of  picture  edge  values. 

A 

Ligure  2.6  is  a  2-D  thresholded  version  of  Figure  2.7. 
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Figure  2-6.  Thresholded  Picture 
17 


Ill .  Target  Extraction 


Introduction 

The  preprocessing  operations  described  in  Chapter  II 
extract  those  points  from  the  picture  which  have  high 
intensity  and  edge  levels.  These  points,  being  constitu¬ 
ents  of  a  target,  appear  in  the  form  of  clusters.  These 
clusters  are  either  the  potential  targets  or  those  areas  of 
the  background  which  appear  as  targets  in  the  imagery.  In 
the  absence  of  textural  details  inherent  in  low  resolution 
imagery,  some  statistical  and  geometrical  criteria  have  to 
be  defined  so  that  the  potential  targets  and  the  background 
noises  appearing  as  targets  can  be  differentiated.  These 
criteria  are  defined  on  the  bases  of  observation  and  analyses 
of  the  results  obtained  after  preprocessing  in  conjunction 
witly  a  priori  knowledge  of  presence  and  location  of  targets 
provided  with  the  data. 

~  This  chapter  defines  the  criteria  which  yield  the 
best  results  and  describes  the  operations  which  have  to 
be  performed  after  the  preprocessing. 

Closedness  -  Two-Neighbor  Criterion 

The  preprocessing  extracts  only  those  points  from 
the  picture  which  have  high  intensity  and  edge  levels.  High 
intensity  level  pixels  are  those  which  constitute  a  target 
or  those  background  areas  which  appear  as  targets.  From 


among  such  points,  only  those  will  have  high  edge  values 
which  lie  on  the  boundaries  of  these  targets  or  target-like 
backgrounds.  Ideally,  then,  only  the  outlines  of  these 
targets  should  appear  in  the  picture  after  the  preprocessing. 
Figure  3.1  depicts  this  situation. 
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X  X  X  X 

-  X  X  X  X 

X  X  X  X 

a.  A  Part  of  Original 

b.  Pixels  with  High 

Picture 

Intensity 

X  X  X  X 

X  X 

I  EG END: 

X  X 

X  =  high  intensity 

X  X  X  X 

=  low  intensity 

c.  Pixels  with  High 

Intensity  and  Edge 

Figure  3.1.  Results  of  an  Ideal  Edge  Detector 
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But  this  is  not  what  actually  happens.  There  are  many  pixels 
left  which  are  unwanted,  as  shown  in  Figure  2.6-  Therefore, 
it  is  necessary  that  the  picture  be  cleaned  of  such  points. 

The  criterion  used  to  get  rid  of  the  unwanted  pixels 
was  based  on  the  premise  that  all  man-made  objects  have 
closed  boundaries.  If  Figure  3.1(c)  is  observed  carefully, 
it  would  be  noticed  that  each  pixel  in  the  outline  of  the 
target  has  two  adjacent  neighbors.  Moreover,  all  these 
points  in  the  outline  are  normal  to  each  other.  Diagonal 
neighbors  do  not  matter.  If,  on  the  other  hand,  a  cluster 
of  points  forming  a  straight  line  or  a  curve,  as  shown  in 
Figure  3.3,  is  observed,  the  situation  is  reversed.  The 


xxxxxxxxxxx 


a.  Straight  Line 


xxxxxxxx 
x  X 

X  X 


B.  Curved  Cluster 


Figure  3.3.  An  Unclosed  Cluster 


points  on  the  extremes  do  not  have  two  neighbors.  But 
another  important  observation  can  also  be  made;  namely, 
that  this  operation  of  checking  the  neighbors  has  to  be 
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reiterated  many  times  to  clean  the  picture  of  all  the  points 
in  a  cluster,  all  of  whose  constituents  do  not  have  two 
neighbors.  Figure  3.4  is  the  same  picture  as  in  Figure  2.6, 
but  after  closedness  test  has  been  made  on  it. 

There  is  one  disadvantage  of  this  criterion.  Figure 
3.5  is  a  representation  of  a  target  and  a  non-ideal  result 
of  an  edge  operator  on  it.  To  a  human  eye.  Figure  3.5(b) 


a.  Target 


b.  Result  of  a  Non- 

Ideal  Edge  Operator 


LEGEND: 


Low  Intensity 


X  =  High  Intensity 


Figure  3.5.  A  Disadvantage  of  Closedness' Criterion 


is  a  perfectly  good  target.  But  not  all  points  constitu¬ 
ting  the  target  have  two  neighbors.  Therefore,  the  target 
is  rejected  by  the  closedness  test,  simply  because  one  point 
is  missing. 
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Figure  3-4.  Results  of  Closedness  Test 


The  disadvantage  of  the  clos^^^dness  criterion,  though, 
does  not  pose  a  big  problem.  The  enhancement  algorithm, 
explained  in  Chapter  II,  tries  to  ensure  that  no  such  points 
in  a  cluster  remain  below  the  threshold  which  would  cause 
the  whole  cluster  to  be  unstable  for  closedness  criterion. 

Another  reason  why  this  disadvantage  is  not  of  much 
concern  is  the  non-ideal  response  of  edge  detectors,  which 
is  explained  in  the  next  section. 

Thinning  -  Maximum  Rectangle  Criterion 

Figures  3.1  and  3.5  are  the  results  of  a  hypothetical 
ideal  edge  detector.  It  is  unreal,  also.  Figure 
3.4  are  the  results  of  real  edge  detectors.  It  is  obvious 
from  the  two  cases  that  edges  do  hot  appear  to  be  fine, 
thin  lines  as  we  desire  them  to  be.  They  are  thicker  than 
they  appear  to  a  human  eye.  It  may  be  because  of  one  or 
both  of  the  following  reasons.  First,  the  basic  mathemati¬ 
cal  ULodel  used  to  represent  the  edges  in  the  formulation  of 
the  edge  detector  may  be  defective.  Second,  the  addition  of 
noise,  due  to  different  sources,  corrupts  the  edges  to  an 
extent  that  they  do  not  exist  in  the  imagery  as  fine,  thin 
lines. 

Blurring  of  the  edges  due  to  noise  and/or  the  inability 
of  edge  detectors  to  detect  them  makes  it  difficult  to 
further  analyze  the  targets  as  they  are.  This  is  due  to  the 
fact  that  the  size  information  of  the  target  is  not  clear. 
This  is  obvious  from  Figure  3.5.  Therefore,  it  is  necessary 
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to  thin  the  edges  to  simple  lines  before  they  can  be 
further  analyzed. 

The  thinning  algorithm  used  is  that  of  fitting  a 
maximum  rectangle  within  the  boundaries  defined  by  earlier 
operations.  The  process  compares  the  outermost  rows  and 
columns  of  a  target  with  the  respective  next -to -outermost 
row  or  column.  The  comparison  is  made  with  respect  to  the 
number  of  pixels  detected  in  each  row  and  column.  This 
operation  is  performed  sequentially  on  all  sides  of  the 
target.  The  row  or  column  with  maximum  detected  pixels  on 
each  of  the  four  sides  is  defined  as  the  final  representa¬ 
tion  of  the  edge  on  that  side.  Figure  3.6  presents  a  flow 
chart  of  this  whole  process. 

The  underlying  idea  behind  this  process  is  that  of 
probability.  The  edge  detection  algorithm  detects  more 
than  one  line  in  each  direction  for  one  actually  existing 
edge  line.  Each  detected  line  is  constituted  by  a  certain 
number  of  pixels  which  fulfill  the  criterion  of  an  edge 
existence  at  that  point.  It  is  logical  to  assume  that  a 
line  consisting  of  more  pixels  is  more  probable  to  represent 
an  edge  than  another  line  with  less  pixels.  Figure  3.7 
illustrates  this  point. 

Figure  3.8  is  an  actual  picture  after  edge  detection 
and  thinning. 
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Figure  3-6.  Thinning 
25 


▼ 


N2  =  #  of  non -zero  pixels  in 
Max  J  -  1 


Figure  3-8.  After  Thinning 


Size  Criterion 


After  thinning  has  been  accomplished,  the  targets 
appear  in  a  form  where  they  can  be  checked  for  their 
actual  physical  sizes.  Because  of  image  enhancement,  the 
sizes  of  the  targets  are  increased.  That  implies  a  target 
would  appear  only  larger  than  3  x  3  in  size.  Therefore, 
all  the  targets  which  are  smaller  than  three  pixels  in  any 
of  the  dimensions  should  be  discarded.  The  limit  on  the 
other  extreme  of  size  is  strongly  dependent  upon  sensor 
optics,  range  and  actual  size  of  the  targets.  Since  all 
of  these  parameters  are  classified  and  were  not  provided 
for  this  study,  it  is  difficult  to  set  any  logical  limits 
on  the  size.  But  just  by  observation  of  all  the  pictures 
in  the  unclassified  data  set,  a  limit  of  8:1  was  determined. 
That  is,  the  two  dimensions  of  the  target  could  be  in  a 
ratio  of  8:1.  Any  ratio  greater  than  that  will  make  the 
target  too  large  in  one  dimension  with  respect  to  the  other 
to  represent  a  real  man-made  object.  Figure  3-9  is  a  final 
version  of  Figure  3.8. 

Another  consideration  which  becomes  very  important  in 
certain  cases  is  the  one  shown  in  Target  A  of  Figure  3.10. 

One  side  of  the  target  is  completely  missing.  What  this 
example  indicates  is  that  a  certain  percentage  of  pixels 
in  the  circumference  of  the  object  has  to  be  detected  if 
that  object  is  to  be  classified  as  a  target.  But  the  question 
is  --  what  percentage?  The  answer  to  this  question  again 
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Figure  3-9.  Results  of  Size  Test 
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Figure  3-10.  Special  Case 


lies  in  the  analysis  of  the  results  achieved  by  using 
different  percentages.  Seventy-five  percent  was  the  final 
percentage  which  seemed  to  give  acceptable  results.  What 
that  means  is  that,  if  751  of  the  total  pixels  which 
theoretically  should  lie  on  the  circumference  of  an  object 
of  a  certain  size  are  detected  during  the  whole  process,' 
that  object  is  a  target.  As  an  example,  if  an  object  is 
five  pixels  by  five  pixels,  the  total  number  of  pixels 
defining  its  circumference  are  20.  Out  of  20  pixels,  if 
(0.75  X  20  =)  15  pixels  are  detected,  that  object  would 
be  termed  as  a  target. 

So  the  objects  which  fulfill  all  the  criteria  explained 
in  the  last  two  chapters  are  termed  as  targets.  Each  one 
of  them  is  given  a  separate  letter  identification  and  printed 
out  by  computer.  Figure  3.11  is  a  final  output  of  Figure 
3.10.  The  reason  why  some  of  the  letters  are  missing  is 
that,  after  edge  detection  and  closedness  tests,  each  cluster 
of  pixels  is  given  a  separate  letter  identifier.  As  each 
test  is  applied,  some  of  those  clusters  get  rejected.  So 
the  letters  identifying  those  rejected  clusters  are  the  ones 
which  get  missed. 
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IV.  Results  and  Discussion 


Introduction 

The  computer  used  for  the  purpose  of  this  study  was  the 
CDC  6600  operated  by  the  Aeronautical  Systems  Division  at 
Wright-Patterson  Air  Force  Base,  and  used  by  the  Air  Force 
Institute  of  Technology  where  this  study  was  carried  out. 

All  of  the  programs  were  written  in  FORTRAN  IV.  A  listing 
of  the  program  and  all  the  subroutines  used  can  be  found 
in  Appendix  D. 

This  chapter  presents  the  results  achieved  and  a  critique 
of  the  algorithm  in  light  of  those  results. 

Results 

A  total  of  325  pictures  was  processed  for  the  purpose  of 
this  study.  The  data  were  provided  by  the  Air  Force  Armament 
Laboratories,  Eglin  Air  Force  Base.  The  pictures  contained 
various  numbers  of  targets  in  different  environmental  condi¬ 
tions.  The  targets  were  tanks  and  trucks  of  different  models, 
some  unknown  objects,  and  fire.  For  199  pictures,  the  infor¬ 
mation  of  the  location  and  kinds  of  targets  in  each  individual 
picture  was  provided.  Therefore,  the  accuracy  scoring  results 
presented  here  are  only  for  199  pictures. 

The  results  achieved  were  analyzed  on  the  basis  of  two 
parameters;  namely,  the  probability  of  detection  and  the 
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probability  of  false  alarm.  Both  of  these  parameters  are  a 
measure  of  ability  and  accuracy  of  the  algorithm  to  detect 
targets  in  a  scene.  For  the  purpose  of  this  thesis,  the 
parameters  have  been  defined  as  follows. 

Probability  of  Detection  =  Number  of  Targets  Detected - 

Total  Number  of  Targets  Present 


Probability 
of  False  Alarm 


Number  of  False  Targets  Detected 
Total  Number  of  Pictures 


The  detected  targets  are  those  targets  which  are  detected  by 
the  process  and  are  also  known  to  be  present.  The  false 
targets  are  those  targets  which  are  detected  by  the  process, 
but  are  known  to  be  not  present.  The  probability  of  false 
alarm  as  defined  above  gives  the  number  of  false  alarms 

also  be  defined  as 

Number  of  False  Targets  Detected 
Total  Number  of  Targets  Detected 


detected  per  picture.  It  can 


Probability 
of  False  Alarm 


This  probability  of  false  alarm  is  that  ratio  of  total  detected 
targets  which  represents  false  detected  targets. 

For  199  pictures  processed,  the  results  obtained  were; 


Number  of  Targets  Present  =  632 
Number  of  Targets  Detected  =  527 
Number  of  False  Targets  Detected  =  57 
Number  of  Pictures  Processed  =  199 
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Therefore , 


Probability  of  Detection 


527 


83.39^0 


Probability  of  False  Alarm: 
by  first  definition  = 


57 

TM 


0.29  per  picture 


by  second  definition 


57 

57  +  527 


9.76% 


The  presence  and  absence  of  targets  in  the  actual  scenes 
were  considered  strictly  on  the  basis  of  information  provided. 
There  were,  however,  instances  where  a  target  was  known  to  be 
present,  but  the  grey  scale  pictures  showed  absolutely  no 
such  indication.  Similarly,  there  were  other  instances  when 
a  target  was  not  shown,  but  the  pictures  showed  the  target 
without  any  doubt.  In  the  latter  case,  the  detected  targets 
have  been  included  in  false  alarms.  But  it  may  be  the  case 
that  some  of  them  are  classified  countermeasures  used  during 
data  collection.  The  algorithm,  as  it  is,  is  susceptible  to 
countermeasures.  But  because  of  lack  of  information  provided, 
no  endeavors  could  be  made  to  adapt  the  algorithm  to  reject 
such  targets. 

The  algorithm  uses  3x3  windows  at  two  stages  --  the  image 
enhancement  and  edge  detection.  The  use  of  windows  has  an 
inherent  disadvantage.  The  disadvantage  is  that  the  rows  lying 
on  the  upper  and  lower  boundaries  and  the  columns  on  the  right 
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and  left  boundaries  of  the  picture  cannot  be  processed.  Using 
the  windows  twice  leaves  out  two  rows  or  columns  on  each 
boundary  without  being  processed.  Therefore,  the  targets  which 
are  wholly  constituted  by  pixels  on  these  unprocessed  rows  or 
columns  remain  undetected.  The  detection  of  targets  which  are 
partly  constituted  by  such  pixels  depends  upon  what  ratio  of 
total  target  is  constituted  of  such  pixels.  This  disadvantage 
need  not  have  any  effect  as  far  as  the  processing  in  a  real 
situation  is  concerned.  In  that  case,  frames  are  processed 
successively  and  a  target  appearing  on  boundary  in  one  frame 
may  well  move  into  the  frame  with  the  movement  of  the  sensor 
platform.  But  this  disadvantage  is  nonetheless  reflected  in 
the  results  presented. 

Discussion 

In  the  real  world,  a  sensor  encounters  infinite  varieties 
of  scenes.  Useful  mathematical  modelling  of  these  scenes, 
partially  or  completely,  has  not  been  accomplished  as  yet. 
Therefore,  it  is  only  logical  not  to  use  any  fixed  numbers  for 
thresholding  the  scenes.  It  is  rather  essential  that  a 
dynamic  thresholding  be  used  which  adapts  itself  to  the 
different  scenes  as  they  are  encountered.  This  was  a  major 
consideration  in  selecting  the  threshold  in  this  algorithm. 

The  threshold  of  mean  plus  variance  is  used  in  this  process. 
Both  mean  and  variance  are  those  of  the  specific  100  x  100 
pixel  picture  being  processed.  That  makes  the  threshold 
dynamic.  It  does  not  use  or  assume  any  a  priori  knowledge 
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about  the  picture.  Dynamic  thresholding  takes  into  consider¬ 
ation  all  kinds  of  situations  like  targets  in  both  cold  and 
hot  backgrounds  simultaneously. 

A  large  amount  of  work  already  done  in  the  field  of 
target  cueing  is  based  upon  one  basic  assumption;  namely, 
some  maximum  possible  target-size.  Such  an  assumption,  if 
logically  made,  does  not  seem  to  affect  the  detection  much. 

But  it  is  a  serious  limitation  as  far  as  range  is  concerned. 
Although  it  would  work  perfectly  at  long  ranges,  it  will 
limit  the  detection  seriously  at  closer  ranges.  The  algorithm 
developed  during  this  study  does  not  make  any  such  assumption. 
The  algorithm  does  limit  the  ratio  of  two  dimensions  of  the 
target,  but  there  is  no  limit  on  the  individual  dimensions 
themselves.  The  man-made  objects  do  have  proportionate 
dimensions,  and  this  is  one  of  the  basic  features  which 
differentiates  them  from  many  other  objects  in  natural  scenes. 

The  current  algorithm  does  not  go  beyond  detection.  It 
does  not  classify  the  targets  into  different  categories. 
Therefore,  a  logical  extension  of  the  algorithm  will  be  to 
develop  and  include  a  classification  routine.  To  cater  for 
such  potential  future  developments  in  the  algorithm,  it  is 
essential  that  the  basic  features  of  the  targets  as  present 
in  the  original  picture  be  preserved.  That  is  exactly  what 
the  algorithm  does.  The  original  intensity  values  of  each 
individual  pixel  do  remain  unaltered  after  the  algorithm. 
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Segmentation  of  targets  after  thresholding  is  one  of  the 
nice  features  of  the  algorithm.  The  segmentation  should  be 
accomplished  in  such  a  way  that  the  targets  can  be  separated 
no  matter  how  close  they  are,  although  the  segmentation 
becomes  difficult  as  the  targets  get  closer.  The  segmentation 
technique  used  by  the  algorithm  separates  two  targets  if  they 
are  one  pixel  away  from  each  other.  On  the  other  hand,  if 
two  segments  are  connected  by  even  one  pixel,  the  technique 
does  not  separate  them.  The  technique  is  simple  and  sensitive. 
It  has  worked  very  well  on  this  data  set.  A  detailed  descrip¬ 
tion  of  segmentation  is  given  in  Appendix  C. 

Another  measure  of  quality  and  success  of  an  algorithm 
is  the  size  of  the  smallest  target  it  can  detect.  It  is 
important  because  it  increases  the  range  of  effectiveness  of 
the  algorithm.  The  farther  the  targets  are  from  the  sensor, 
the  smaller  they  will  appear  in  the  image.  The  smaller  the 
targets  an  algorithm  can  detect,  the  greater  the  range  of 
effectiveness  of  the  algorithm.  In  other  words,  this  is  a 
measure  of  "sensitivity"  of  the  algorithm  analogous  to  the 
sensitivity  of  a  receiver.  The  present  algorithm  can  detect 
targets  as  small  as  2  pixels  x  2  pixels.  This  is  the  smallest 
possible  size  a  target  can  have  in  the  image.  Smaller  size 
than  2x2  would  mean  a  point  or  a  line,  which  is  hard  to 
perceive  as  a  target.  This  small  resolution  would  determine 
the  effective  range  of  the  overall  thermal  imaging  system  of 


which  this  algorithm  will  be  a  part.  Because  of  the  non¬ 
availability  of  optical  parameters  of  the  sensor  such  as 
field  of  view,  range  from  the  target  and  actual  target  size, 
it  is  not  possible  to  say  what  range  this  2x2  pixels 
resolution  translates  into.  But  it  is  certain  that  this  is 
the  best  that  can  be  achieved. 

The  detection  of  such  small  targets  was  made  possible 
by  the  image-enhancement  technique  developed  in  this  algorithm 
Image-enhancement  not  only  improves  the  contrast  of  targets 
with  respect  to  their  background,  it  also  enlarges  the  target 
size.  This  enlargement  of  size  results  in  a  disadvantage  as 
far  as  separation  of  targets  is  concerned.  The  targets  which 
lie  very  close  to  each  other  merge  into  each  other  to  appear 
as  one  target  after  enlargement  because  of  image-enhancement. 

In  the  final  analysis,  both  the  targets  do  get  detected,  but 
as  one  target.  There  were  no  such  close  targets  in  the  analyzed 
data;  therefore,  no  proper  statistics  such  as  how  far  the 
targets  have  to  be  from  each  other  to  be  detected  separately 
can  be  presented.  The  same  effect  is  adversely  felt  when  a 
target  is  very  close  to  noise  of  large  spatial  size.  Since 
the  large  unproportionate  objects  are  not  detected  by  the 
algorithm,  image-enhancement  merges  the  target  into  the  noise 
and  the  target  is  missed. 

The  algorithm  only  detects  the  hot  targets.  Targets 
which  are  cooler  than  the  background  cannot  be  directly 
detected,  although  the  same  kind  of  thresholding  and 
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processing  as  done  for  hot  objects  could  be  used  for  detecting 
the  cold  objects  with  a  little  modification. 

The  algorithm  in  its  present  form  has  no  classification 
capability.  The  tanks  and  trucks  cannot  be  separated  from 
each  other,  and  both  of  them  cannot  be  separated  from  any 
other  kind  of  target  or  noise  that  might  appear  as  a  target 
in  a  scene.  Therefore,  the  algorithm  is  extremely  susceptible 
to  any  kind  of  countermeasure  that  might  be  used  against  it. 

Despite  all  these  drawbacks  and  limitations,  the  algorithm 
seems  to  work  extremely  efficiently  as  far  as  final  results 
are  concerned. 


r 

V.  Conclusions  and  Recommendations 


Conclusions 

The  purpose  of  this  study  was  to  detect  the  targets 
(the  man-made  objects)  from  the  low-resolution  infrared  imagery. 
The  targets  were  defined  to  be  those  homogeneous  proportionate 
areas  in  the  picture  which  are  constituted  by  pixels  having 
intensity  values  above  a  certain  threshold  and  the  areas  are 
bounded  by  the  pixels  having  edge  values  greater  than  certain 
thresholds.  Targets  as  small  as  2  pixels  x  2  pixels  were 
considered  and  detected. 

The  whole  process  consisted  of  six  steps: 

(1)  Image  Enhancement 

(2)  Edge  Detection 

(3)  Thresholding 

(4)  Connectedness  Test 

(5)  Thinning 

(6)  Size  and  Proportion  Test 

A  total  of  325  pictures  was  analyzed  during  the  develop¬ 
ment  of  this  algorithm.  The  data  set  was  prepared  using 
different  targets  like  tanks  and  trucks  under  different 
environmental  and  weather  conditions.  The  results  achieved 
were: 

Probability  of  Detection  =  83.39% 

Probability  of  False  Alarm  =  9.76% 


42 


Because  of  time  constraints,  no  work  could  be  done  on 
classification  of  targets.  The  algorithm  detects  potential 
targets,  but  is  not  capable  of  classifying  the  detected 
targets  into  tanks  or  trucks.  Moreover,  the  time  constraints 
did  not  allow  the  analysis  of  all  pictures  at  different 
stages  of  detection.  This  kind  of  analysis  will  find  at 
what  stage  the  missed  targets  are  being  lost.  This  could 
lead  to  further  improvements  in  the  algorithm. 

Recommendat ions 

The  algorithm,  as  it  is,  has  given  very  encouraging 
results.  Therefore,  it  seems  reasonable  to  assume  that  the 
approach  leads  in  the  right  direction.  Because  of  time 
constraints,  the  study  could  not  be  carried  on,  but  it  is 
recommended  that  the  work  be  continued  in  the  following 
directions . 

(1)  Analysis  of  more  data  with  the  same  algorithm 
to  ascertain  the  performance  of  the  algorithm  under  different 
environmental  conditions.  A  rigorous  analysis  might  result 
in  a  better  understanding  and  thus  pave  the  way  for  further 
development. 

(2)  Analysis  of  a  large  set  of  data  under  different 
stages  of  detection  process.  Such  an  analysis  could  pinpoint 
the  stage  which  results  in  maximum  and  most-often  misses. 

That  stage  can  be  further  improved  upon. 
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(3)  Classification  is  the  most  obvious  next  step. 

A  rigorous  statistical  analysis  of  the  detected  targets  may 
result  in  determination  of  features  capable  of  differentiating 
between  a  tank  and  a  truck.  A  preliminary  effort  was  made  in 
this  direction,  but  it  did  not  prove  successful.  The  pixels 
in  a  detected  target  were  divided  into  four  categories, 
depending  upon  their  relative  intensities.  For  this  purpose, 
the  mean  and  variance  of  every  individual  target  was  found. 

The  division  of  the  pixels  was  as  follows: 

A.  pixels  having  intensities  greater  than 
mean  plus  variance 

B.  pixels  having  intensities  between  mean 
and  variance 

C.  pixels  having  intensities  between  mean 
and  mean  minus  variance 

D.  pixels  having  values  less  than  mean 
minus  variance. 

F4gure  5.1  shows  a  picture  in  which  pixels  in  detected 
targets  have  been  classified  in  this  way.  It  is  hoped  that 
this  kind  of  processing  will  make  it  possible  to  understand 
the  textural  qualities  of  the  targets  and  thus  classify 
them. 


•  ! 
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APPENDIX  A 


Data 

The  data  for  325  pictures  were  provided  by  Eglin  Air 
Force  Base,  stored  on  magnetic  tapes.  The  data  were  stored 
in  the  Standard  Target  and  Background  Information  Library 
System  (TABILS) .  A  TABILS  picture  is  made  up  of  102  four 
hundred  character  BCD  records  on  the  tape.  The  first  two 
records  contain  values  of  different  environmental  parameters 
at  the  time  the  picture  was  taken.  Tables  A-1  and  A-2  give 
the  details  of  these  parameters,  the  order  and  format  in 
which  they  are  stored.  Records  3  through  102  contain  the 
TABILS  thermovision  picture  in  counts.  Values  range  between 
0  and  1023.  A  value  of  1023  counts  represents  "saturated 
data."  A  value  greater  than  1023  represents  "no  data"  for 
that  particular  cell. 

A  picture  is  made  up  of  100  lines,  each  containing  100 
words  or  10,000  values.  Each  record  on  tape  is  400  charac¬ 
ters  long,  representing  100  words  on  the  line.  Each  of  these 
data  records  is  stored  as  100  14.  Alignment  of  the  picture 
is  as  follows: 

Line  1  =  Back  of  3-D  picture  as  perceived  by 

viewer 

Line  100  =  Front  of  3-D  picture  as  perceived 
by  viewer 


Word  1 


=  Left  side  of  3-D  picture  as  perceived 
by  viewer 

Word  100  =  Right  side  of  3-D  picture  as  perceived 
by  viewer. 

To  change  the  count  values  to  radiance  (watts/cm^ -=2y ) 
the  conversion  factor  slope  and  conversion  factor  intercept 
must  be  used  from  record  2. 


where 


y  =  mx  +  b 

m  =  conversion  factor  slope 

X  =  count  value  of  picture  cell 
b  =  conversion  factor  intercept 

y  =  radiance  value  of  cell. 


In  the  particular  case  of  this  thesis,  the  first  two 
records  of  every  picture  were  blank.  Therefore,  the  conver¬ 
sion  factors  of  both  slope  and  intercept  were  not  available. 
This  fact  led  to  the  processing  of  pictures  not  with  the 
radiance  values  for  each  cell,  but  the  count  values.  Since 
the  transformation  from  radiance  to  count  values  is  linear, 
therefore,  no  contrast  reduction  was  assumed.  Rather,  it 
was  advantageous  to  manipulate  small  numbers  on  the  computer. 
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TABLE  A-1 
Labelling 


Parameter  Name 

Format 

Comments 

Target  Code 

13 

Coded  Item 

Background 

2A10 

Countermeasures  Code 

13 

Coded  Item 

Band  Code 

13 

Coded  Item 

Collection  Agency 

2A10 

Test  Side  Location  Code 

13 

Coded  Iten 

Mission  Date 

A6 

YYNWDD 

Weather  Code 

A1 

G  (Good)  or  B  (Bad) 

Weather  Description 

4A10 

Measuring  Instrument 

2A10 

Target  Viewing  Angle 

16 

in  Degrees 

^  A 

Depression  Angle 

16 

in  Degrees 

Range 

16 

in  Meters 

Scene  Description 

7A10 

RPM  (Target) 

16 

Prior  Vehicle  State  (Target) 

AlO 

Cold,  exercised  or 

Prior  History 

4A10 

idled 

Relative  Bearing  Angle 

16 

in  Degrees 

Wind  Direction 

16 

in  Degrees 

Visible  Transmission 

16 

in  Percent 

IR  Transmission 

16 

in  Percent 

IR  Transmission  Band  Code 

16 

Coded  Item 

Pyranometer  Reading 

16 

in  Watts/meter^ 

Pyrheliometer  Reading 

16 

in  Watts/meter^ 

Filler 

16 

95  Blank  Characters 

Angle  measured  from  the  target  pointing  vector  to  the  ground 
projection  of  a  line  from  the  target  to  measuring  instrument 
(positive  clockwise) 

**  Angle  measured  from  the  horizontal  to  the  measuring  instrument 
pointing  vector  (positive  down) 

***  Angle  measured  from  true  north  to  the  ground  projection  of  a  line 
from  the  measuring  instrument  to  the  target  (positive  clockwise) 


TABLE  A- 2 
RecordZ  Labelling 


Parameter  Name 

Format 

Comments 

Picture  Time 

F10.3 

IflM^SS.SSS 

Conversion  Factor  -  Slope 

F20.15 

Conversion  Factor  -  Intercept 

F20.15 

Picture  Comments 

7A10 

Horizontal  Resolution 

F6.3 

in  Milliradians 

Vertical  Resolution 

F6.3 

in  Milliradians 

Relative  fiimidity 

F10.2 

in  Percent 

Wind  Speed 

F10.2 

in  Knots 

Air  Tanperature 

FlO.l 

in  Degrees  Centigrade 

Barometric  Pressure 

FIO.O 

in  Millibars 

Rain  Rate 

F10.2 

in  Millimeters/hour 

Snow  Tenperature 

F10.2 

in  Degrees  Centigrade 

Soil  Moisture  Content 

F10.2 

in  Percent 

Visibility 

F10.2 

in  Kilometers 

Filler 


188  Blank  Characters 


APPENDIX  B 


The  pictures  from  the  tape  were  printed  on  a  line 
printer  using  a  combination  of  overprinted  characters. 

Because  of  the  size  of  the  picture  (100  x  100),  the  line 
printer  posed  no  restrictions  in  printing  the  complete 
horizontal  line  completely.  For  larger  sizes  of  pictures, 
the  maximum  characters  a  line  printer  can  print  in  a  horizontal 
line  may  be  a  serious  limitation. 

A  maximum  of  eight  overprinted  characters  for  maximum 
intensity  was  used.  The  density  codes  (i.e.,  the  overprinted 
character  combinations)  are  given  in  Table  B-1. 

As  shown  in  Table  B-1,  the  combinations  of  overprinted 
characters  appear  for  values  between  0  and  1.  Therefore, 
the  whole  picture  values  to  be  printed  were  linearly  scaled 
down  between  0  and  1. 

y  =  mx  +  b 

X  =  count  value  of  picture  cell 
m  =  1.0  /  (max  -  min) 

b  =  m  *  min 

y  =  scale  down  value  of  picture  cell 
max  =  maximum  count  value  of  picture 

min  =  minimum  count  value  of  picture. 


This  method  of  printing  the  pictures  produced  a  variant 
of  the  nominally  expected  picture-  The  hotter  points  in  the 
picture  have  high  intensity  and  thus  would  be  expected  to 
appear  lighter  in  the  picture.  But  the  combinations  of 
overprinted  characters  is  such  that  the  higher  density, 
i.e.,  the  hotter  points,  appear  as  dark  points  in  the  printed 
picture.  This  representation  of  the  data  was  found  to  be 
perfectly  satisfactory. 
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TABLE  B-1 


Overprinted  Character 
Combinat ions 

Intensity 

Value 

Blank 

0.00 

- 

0.15 

= 

0.22 

+ 

0.25 

> 

0.29 

I 

0.33 

z 

0.37 

X 

0.40 

A 

0.42 

M 

0.45 

0- 

0.53 

0= 

0.56 

0  + 

0.60 

-  0+" 

0.64 

0+'* 

0.67 

0+'*  = 

0.79 

0  +  '*  - 

0.85 

0x'*HC 

0.89 

0x'*HB 

0.93 

Ox'-HBV 

0.97 

Ox'*HBVA 


1.00 


APPENDIX  C 


Segmentation 

After  the  connectedness  test  has  been  accomplished, 
the  pictures  contain  only  a  few  scattered  blobs  that  have 
to  be  tested  to  determine  if  they  are  true  representatives 
of  actual  targets.  Before  this  task  can  be  accomplished, 
it  is  essential  that  these  blobs  be  numbered  separately 
so  that  they  can  be  individually  analyzed.  This  process 
of  separating  the  blobs  for  computer  use  is  called  segmen¬ 
tation. 

For  the  purpose  of  this  study,. the  segmentation  was 
achieved  in  two  steps.  The  basic  purpose  of  separating  the 
blobs  was  served  by  the  first  step,  but  in  certain  cases  all 
the  pixels  in  a  blob  are  not  numbered  similarly  by  the  first 
step.  Therefore,  the  second  step  is  used  in  order  to  keep 
the  numbers  the  same. 

Af-ter  the  connectedness  test,  most  of  the  pixels  in 
the  matrix  are  left  with  a  value  of  zero.  Only  those 
pixels  which  form  a  part  of  the  blobs  have  a  non-zero  value. 
So,  essentially,  what  segmentation  has  to  achieve  is  to  give 
a  particular  integer  value  to  all  non-zero  pixels  which  are 
connected  together.  Another  task  which  segmentation  must 
perform  simultaneously  is  to  increment  or  change  that 
particular  integer  value  once  it  detects  a  blob  which  is  not 
connected  to  the  previous  one. 


Figure  C-1  is  a  picture  after  connectedness  tests  have 
been  performed.  In  the  first  step,  the  picture  is  scanned 
from  left  to  right,  starting  from  the  third  row.  The  first 
two  rows  are  left  because  they  have  not  been  processed 
because  of  use  of  3  x  3  windows.  Before  the  start  of  the 
scan,  a  counter  is  set  to  zero  and  another  matrix  (integer 
matrix)  with  the  same  dimensions  as  the  picture  matrix  is 
initialized  with  all  pixels  having  a  zero  value.  During  the 
scan  of  the  picture  matrix,  whenever  a  non-zero  pixel  is 
detected,  the  scanning  stops.  The  upper  and  left  pixels  in 
the  integer  matrix,  corresponding  to  upper  and  left  pixels  of 
the  detected  non-zero  pixel  in  the  picture  matrix,  are  checked 
for  non-zero  values.  If  any  one  of  them  is  non-zero,  the  same 
value  is  given  to  the  pixel  in  the  integer  matrix  correspond¬ 
ing  to  a  detected  non-zero  pixel  in  the  picture  matrix.  If 
both  of  them  are  zero,  the  counter  is  incremented  by  1  and 
the  value  of  the  counter  is  assigned  to  the  pixel  in  the 
integ^  matrix  corresponding  to  a  detected  non-zero  pixel  in 
the  picture  matrix.  The  scanning  resumes  and  the  process 
continues  until  the  picture  is  finished.  Figure  C-2  is  the 
representation  of  Figure  C-1  after  the  first  step  of  segmen¬ 
tation. 

It  should  be  noticed  that  not  all  the  points  in  all 
the  blobs  are  numbered  the  same.  This  is  because  the  first 
step  does  not  consider  all  possible  shapes  a  blob  can  assume. 
Therefore,  a  second  scan  of  the  integer  matrix  is  performed. 
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Figure  C-1.  Picture  After  Closedness  Test 
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Figure  C-2.  Picture  After  1st  Step  of  Segmentation 
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During  the  scan  of  the  integer  matrix,  when  a  non-zero 
pixel  value  is  encountered,  the  scan  stops.  The  processing 
is  done  in  the  following  stages: 

(a)  (i)  If  the  pixel  on  the  right  is  zero  or  has 
the  same  value  as  the  one  under  consideration, 
to  to  the  next  stage  of  processing. 

(ii)  If  the  pixel  on  the  right  is  not  zero  and 
does  not  have  the  same  value  as  the  pixel 
under  consideration,  assign  the  minimum  of 
the  two  values  to  both  of  them  and  to  to  the 
next  stage. 

(b)  Perform  the  same  steps  as  in  (a),  but  this  time 
with  the  pixel  on  the  left  and  the  detected 
non-zero  pixel. 

(c)  Perform  the  same  steps  as  in  (a),  but  with  the 
lower  pixel  and  the  detected  non-zero  pixel. 

Before  the  scan  starts,  a  counter  is  set  to  zero. 
Whenever  a  situation  is  encountered  when  a  non-zero  pixel 
does  not  have  the  same  value  as  one  of  its  left,  right,  or 
lower  non-zero  neighbors,  the  counter  is  incremented  by  one. 
After  the  (a),  (b) ,  and  (c)  stages  have  been  completed,  the 
scan  resumes  until  the  total  integer  matrix  has  been  scanned. 
After  the  total  matrix  is  scanned,  the  value  of  the  counter 
is  checked.  If  the  value  is  non-zero,  the  whole  scanning 
of  the  integer  matrix  is  repeated  with  the  counter  reset  to 
zero.  This  process  is  repeated  until  a  zero  value  in  the 
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counter  is  encountered  after  a  complete  scan  of  the  matrix 

Figure  C-3  is  the  final  segmented  picture. 

Figures  C-4  and  C-5  are  the  flow  diagrams  for  the  two 

segmentation  steps,  respectively. 
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Figure  C-3.  Picture  After  Segmentation 
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I  =  2;  J  =  2 
Matrix  -  After  1st  Step 
Ccxinter  =  0 


Yes 


'Matrix(I,J-l)=0 


1 


APPENDIX  D 


Program  Listing 


The  following  pages  present  the  source  listing  of 
the  final  program  used  to  detect  targets. 
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FOLLOWINC  is  THF  '-IKrTlFN  For  DETECriNG  ’aFGErS  F><CM  LOW* 

F;£S3L>'TIOiv  IK  If'iS"?''.  PICTURES  AK€  1n  THE  FCH  D*  A  1^:*  * 

IJ.  MATRICES.  THE  OSTA  '•I»G  FkOVICED  »Y  EGLIS  AIR  FORCE  3ASE.  ' 
THE  DATA  TAPE  IS  WIM  T-IE  ASD  COMPUTER  CENlEr.  UNDER  PR33LEM  #  • 

T7r'6l  6  ASO  VSN=< ‘•■?3 'ft.  IT  IS  ATTACHED  AS  TA  PES  BE- ORE  THE  • 
PROGRAM  IS  RUN.  IHi;  pROG'^AM  THEN  EXECUTES  THE  ALGORITHM  D£»/EL-* 
OPED  F.Y  FLT.  LT .  HA^ATATI  AND  PRINTS  THE  RESULTS  C-  EACH  STAGE  * 
IN  THE  ALGORITHM  IN  GRA'^-SCALE  AS  CONTAINED  IN  SUBROJrtNE  ♦ 

CCGRAY.OA«  POINTS  5-»£  ’’HF  HOT  POINTS.  * 


»•♦**#*.***•.»**»«»•«••*»  ^  « 

*  LIST  3'^  VAPIABLES  * 

*  MATPIX=  ORIGINA.  Pr'ITUR'’  MATRIX  * 

*  JATRIX=  IMAGE  ENHA'J''EO  PICTURE  MATRIX  .♦ 

*  NATFIX=  EDGE  MATRI<  0^  JATRIX  * 

*  SCAMAT=  ANY  MATRIX,  TO  PRINTED, SCALED  BETWEEN  ♦  _ 

*  7  AND  1  ♦ 

*  MINI=  UPOEPROST  ROJ  Qp  A  CONKFCTED  CLUSTER  * 

*  MINJ=  LEFTMOST  COLJHN  OF  A  CONNECTED  CLUSTER  * 

»  MAX1=  LOHERHOST  ROR  OP  A  CONNECTED  CLUSTER  ♦ 

*  HAXJ=  RIGHTMOST  CO. JMN  OP  A  CONNECTED  CLUSTER  * 

*  ITESTs  A  OUMMY  rfARrSBL-  WHICH  DETERMINES  WHETHER* 

*  OR  NOT  A  CL'JST-R  R-ppESENTS  A  TARGET  * 

*  NPs  #  OF  MOt>ZERO  ’’’XELS  IK  A  TAFGET  BOUNDARY  ♦ 

PROGRAM  ZAINAB (INPUT,  OUTPUT, TAPE5s/VG0) 

COMMON  SCAHSTdiffir  ) 

DIMENSION  MATRIXdCI,  fl)  ,  M  ATRI X  ( 1.  J  ,  1  ;0  >  ,SC  A  HAT  (1 1  j  ,  IJ  0)  , 

♦  jATRixd*  j,i:  ; )  ,drRTX(iu.,iuc> , 

♦  MINl(3C.),MINJd:),HAXT{''l>  ,MAXJ(3  >  ,ITESr(  3'. )  ,NF{3:) 

»'»♦*♦«*  If  4  ,,444*4  4-,, » 

*  THE  PICTURE  IS  REAl  "RO^  TAPE?.  FIRST  TWO  RECORDS  » 

*  APE  BLANK,  THEREFORE  THEY  ARE  READ  INTO  DJHMY  VAR-  » 

*  TABLES.  NEXT  Id  RECORDS,  WITH  iLf-  VALUES  EACH,  ARE  * 

*  READ  INTO  THE  MATRIX.  * 

ReA0(5,l)A 

R£A0<5,1)8  - - 

i 


ic 

ifU5 


FORMAT (laj 
DO  1  1=1, IOC 

READ  (5, 9)  E)  (MATRIX  (I,  J)  ,  J=l,l.iC) 

CONTINUE 
FORMAT  (lOCI^) 

•  US^Cf's-S  SiSSoMS.  evaluated  BtCAJSE  0^* 

,♦♦4. 44 4444, 


iTc 

S5 


00  55  1=2, *39 
00  5..  J=2,99 

IA=IABS((1  *(“ATPIXCr-l,  J-1)+MATRIX(I-1,  J)+*HTP1X(I-1,  Jfl)))  -  ( 

♦  MATRIX  <  I,  J«-l)  +-tAr?r  X(:*1,J+1)+MATRIX{I+1,  J)*MATRrX{r+l,  J-t>  ♦ 

♦  MATRIXd,  J-1)^) 

IB=IABS<(l.MHATRIX(r-l,  1)  ♦^HATRIX  ( I-l ,  J+ 1)  ♦‘li  TRIX  ( I,  J  H) )  )  -  ( 

♦  MATRIX  ( If  1,  J4l»  fMd^irX(rfl,J)+MATF.IX(Ifl,  J-1)  fM  AF  ?!  <  ( I ,  J-t )  f 
f  MATFIX{I-1,J-H)) 

IC=IABS((1J* (MATRIX (E-1,  J  +  l ) f MATRIX { I , Jfi ) fM A TRI X{ If 1, Jf 1))) -( 

♦  MATRIX (If l,J)+MAT^:x (If 1,J-1) fMATftIX(I,J-l )fMATRlX(I-l,J-l)  f 
f  MATRIXd-l,  J))) 

I0=IABS((1  ,*(VATFtX(r,  Jft)  fMATRiX  (If  l,Jfl)f  MATRIX  (in,  J))  )-( 

♦  MATRIXdfl,  J-l»  f  MMRTX  ( I,  J-l)f  MATRIX  (1-1,J-1)  fMAIRU  (I -1,  J)  f 

♦  MATRIXC-i,  Jfin  1 

IE=IABS((1» (MATRIX (r  fl , |f 1) f MATRI X ( I f 1, J) f M A TRI X ( If I, J-l ) ) ) - ( 

♦  MATFIXd,  J-l)fMAT?TX(I-i,J-t>fMATRIX(I-l,  J)fMATRIX(I-l,Jfl)  f 

♦  MATRIXd,  Jf  1)) ) 

IF=IABS((1  '(MATRIXir  ♦!,  I)  f  MATRIX  ( If  1 ,  J-1)  f  M  A  7FI X  ( I,  J- 1 )  )  )  -  ( 

♦  KATRIXd-l,  J-l»fM»  ’■‘?IX(I-i,  J)f  MATRIX  (I -l,Jfl)  fHAl  RIXCI ,  Jf  1)  f 
f  MATRIXdfl,  Jfl»  )  ) 

IG=IABS  ((!*:►  (MATA  IX  (r  fl,  i-l> f  MATRIX!  I ,  J-1  > fMA  TRI  X (  >1 ,  J-i>  ) )  -  ( 

♦  MATRIX(I-1, J)f MAT?rX(T-l,Jfl)fKATRIX(l,Jfl )fMATRIX(Ifl ,Jfl) f 

♦  MATRIXdfl,  J))) 

IH=IABS ((i:* (MATRIX (f , J-1 »  f MA TRIX ( I- 1 , J-1) f MA TKI X( I- 1 , i) )  »-( 
f  MATRIX(I-1,  Jfl»  fMJ  Ti>IX(I,Jfl)  fMATRIXdfl,  Jfl)  fMAIRlX  (I  fl,  J)  f 

♦  MATRIXdfl,  J-l»)) 

NAX=i 

JATFIX(I,J)sMAXl (IA,rB,r3,10,IE,IF,IG,IH,l) 

CONTINUE 

CONTINUE 


f  MEAN  AND  VAFIAKCc  3F  ^ME  IMAGE  ENMANCED  PICTURE  IS  * 
*  EVALUATED.  ^ 


f  » . 


ff 


CALL  THRESH(JATKI<,9- AMI, VARi) 


*  THE  EDGE  MATRIX  FO?  TM-  IMAGE  ENHANCED  PICIURE  IS  » 

*  EVALUATED.  AGAIM  TM'  EX^^’EME  ROWS  AND  COLUMNS  OF  *■ 

*  THE  IMAGE  ENHANCED  ^ICrURE  HAVE  BEEN  LEFT  DU7.  *1 


00  hS  1=3,99 
00  ‘  f  J  =  3,B9 

IA=IABS((E*(  JATRKd-  I,  J-l)  f  JATRIX(I-1,J)  fJAI  RIX  (I -I',  Jf  t )  )  )  -  (  3  ( 
f  JATKIXd,  Jf  l)f  JATdXdfi,  Jfl)f  JATRIXdfl,  JJfJATNtXdfl,  J-1)  f 

f  JATRIXd,  J-1) ))  ) 

I3=IABS  (('■»(  JATF  IX  (I-l,  J)  f  JATRI X (I-l ,  Jf  1)  f  JAT  RIX  (I  ,Jf  1) )  )  -  (3»  ( 
f  JATRIXdfi,  Jfi)  f  JA  TRIX dfl,J)fJATRlX(Ifl,  J-1)  f  JAIRIXd  ,  J-1)  f 

♦  JATRIXd-l,  J-1)  )  )i 

IC=IABS  ((if  (JATRI  X  d-1,  Jfl)  fJATFIXd  ,  Jfl)  fJAI  RIX  (in,  Jfl)  ))  -  (3*  ( 

♦  JATRIXdfi,  J)  f  JATdX(:fl,J-i)  f  JATRIXd,  J-1  )  fJATFIXd -I,  J-l)  f 
f  JATRIXd-l,  J)))) 

1 0=IA  BS  df  (JATRIXd,  Jfl)  f  JATRIXdfi,  Jfl)  f  JAT  FIX  (in,  J) )  )  -  (3M 
f  JATRIXdfi,  J-H  f  JA  'Rrr(I,J-i)  fJATFiXd-l,  J-1)  f  JAT  RIX  ( I -1 ,  J)  f 
f  JATFIXd-l,  Jfl)))» 


)^Q 

45 


20 

25 


lEsIABS  ((5*  (J^TftlXd^t,  J*1)+JATRIX(I+1,  J)  ♦JAf  kIX(I*l,  J-1)  )  )-(3 

♦  JATFIXCI,  J-1)  ♦JATerX(r-l,J-l)+JATMX(I-i,  J  )+JATRIX(I-i,  J  +  1)  + 

♦  JATklX(I,J-H)  ))  ) 

IF=IABS  ((5^(JATRlX(Tvt,  J>  ♦  JAT R1  X (I +1 ,  J-1 )  ♦JA f  RIX  (I  ,J-l» )  )  -  (3M 

♦  JATRIXd-l,  J-1)  +JSrRIX(I-l,J)+JATRIX(I-l,  J+l)  ♦JATRIX  (I  ,  J  +  l)  ♦ 

♦  JATRIXd+lt  J+l> )  >» 

IG=Ifi9S({5»(  JATRIKdd,  J-1)  ♦  JATPIXd  ,  J-1)  ♦JA  f  RIX  (I -I  f  J- 1)  ))  -  (3 

♦  JftTUXd-l,  J)  +  JAT?rX(r-i,J*l)*JATRIXd,Jfl  )+JATRIXd+l,  J*l)  ♦ 

♦  JATRIXCl+lf J)))) 

IH=IABS((E+(JATRIXd,  J-l)  +  JAT  RI X  CI-l ,  J-1)  ♦JA  F  RIX  d -1 ,  JU  J  -(3"  ( 

♦  JATRIXd-i,  J+ll  ^Jl  ^RIX(I,J*1>+JATkIX(IM,  J  ♦!>  +JAr^IXd+l,  J)  + 

♦  JATRIXd  +  i,  j-in )» 

NAX=w 


.  NAX=MAXC{IA,I5>IC»I0,TE:,Tr,iG,IH) 

NATRlXd,J)=HAXC  (IfMIX) 

CONTINUE 

CONTINUE 

•  FIRST  THE  HEAN  ANO  'M.RIANCE  OF  THE  EDGE  MATRIX  IS  EXALJA- 

•  TED.  SECOMOLY  THE  AND  MAXIMA  FOR  ALL  THE  MATRICES 

•  AVAILA8LE  AFE  CALCJLATEO, 

•  MAX=  MAXIMUM  VA.JE  TM  IMAGE  ENHANCED  PICTJRE 

•  MIM=  MINIMUM  VA.UE  I'l  TMAGE  ENHANCED  PICTURE 


HAX1= 

MAX. 

VALUE 

IX 

ORIGINAL 

PICTURE 

4 

MIN1  = 

MIN, 

VALUE 

I'J 

ORIGINAL 

PICTURE 

4 

MAX  2* 

MAX. 

VALUE 

IX 

the  edge 

MATRIX 

* 

MIN2  = 

MIN, 

VALUE 

TV 

’“HE  EDGE 

MATRIX 

» 


CALL  THR£SH<HATFIX,0-AX2,  VAR2) 
MAX=JATRIX<Z|2) 

HAXlsMATRIXd,  1) 

MAX2=NATFIX(3,3) 

MIN=JATRIX(2,2) 

HIN1=KATR1X(1,1) 

MIN2=NATRIX(3,3) 

DO  29  1=3,  33 
DO  2i  J=3,<33 

MIN=MINr(MN,  JATFIXd,  J>) 
MIN1=MIN  (MINI  jMATRKd,  J)) 
MIN2  =  MIN: (MIN2,NtTRI< (T,  ))) 
MAX=Max<:  (MAX,  JATRTX(r  ,  J)) 

HAX1  =  MAX''  (MAXI, MATRIX  d,  J) ) 
MAX2SMAX. (MAX2, matrix (1,1)) 


CONTINUE 

CONTINUE 

4*#«  «  n  **  4.  #  4  4  *  » 

•  THE  ORIGINAL  MATRIX  IS  SCALED  DOWN  • 

•  BETWEEN  :  A  1  A^O  THEN  ORINTcD.  * 

»  THE  EXTREME  ROWS  A  CDL'IMMS  OF  ORIG-”* 

•  INAL  MATRIX  AND  TM)SE  ROWS  I  COLUMNS* 

•  WHICH  COULO  NOT  9E  EVALUATED  ARE  * 

•  FILLED  WITH  RES’ECIVE  “AXIMUM  VALUE* 


Asl.^/(MAX1-MIN1) 

B=A*MIN1 
DO  35  1=2,99 
DO  3t  J=2,99 

SCAMftT(I,J)=(A»MArRI< (I, J)) -B 

34  CONTINUE 

35  CONTINUE 

00  2E  1=1, icr 

SCAMAT(I,1.)C)  =l.r 
JATRIX<I,i:?)=MAX 
MATRIXd,!  ■5)=MAX2 
SCARAT (ltC,I)=i.r 
JATRIXdi  (  ,I)  =  MAX 
NATRIX(1C'C,I)  =  «AX2 
SCANAT(I,i)si.i. 

JATR1X(I,1)=HAX 

NATRIX(I,1)=MAX2 

SCAMAT(l,I)=i.^ 

JATRIX(1,IJ=h6X 

NATRIX<1,I)=MAX2 

36  CONTINUE 

00  8.'  1  1=2,99 
NATRIX(I,2)=MIN2 
NATRIX<2,1)=MIN2 
NATRIX(I,9'?)=HIN2 
NATkIX(99,I>=RlN2 
801  CONTINUE 

WRITE  37, NIL 

37  F0RMAT(”1  F0LL0WI*i5  19  TH9  PICTURE  f",I3) 

CALL  CCGRAY(«?ATR1<) 

♦  THE  IMAGE  ENHAMED  oi^T'JRE  IS  SCALED  » 

•  OOMN  BETWEEN  i  5  1  ANT  THEN  PF1N7ED.  » 

•  EDGE  MATRIX  IS  FHE'I  SCALED  DOWN  AND  *1 

*  PRINTED.  » 

Ast.'/tMAX-MIN) 

8=A'K1N 
00  22  1=1,10- 
00  21  j=i,i:c 

SCAKATd,  J)  =  (A*JArRI<  (I,  n)-B  " 
ai  CONTINUE 

22.  CONTINUE 

WRITE  19,  NIL 

19  FORHATC’l  FOLLOWING  IS  IN  AG  E»  ENHANCED  PICTURE  #**,I 
CALL  CCGRAYCBATRIO 
A=l.  /(HAX2-MIK2) 

B=A'MINE 
DO  18  1=1, ICO 
00  17  J=1,10'? 

SCAMAT  (I,  J)  =  (A‘^NArRI<  (I,  J))-0 


17 


CONTINUE 


15 

16 


36 

39 

13 


6  33 


821 
8  22 

823 

824 

£19 
6  20 

l2 


CONTINUE 
WRITE  16, NIL 

FORK^TC'l  FDLLOWISS  fS  THE  EDGE  MATRIX  #“,I3) 
CALL  CCGRAY(BATRIX) 


*  INT=  THPESHCLO  -OR  IMA';E  ENHANCED  PICTURE  * 

*  IEDGE=  TMRE5H0L3  F5R  EOGE  MATRIX  * 

*  THE  SCALED  OCMN  MAr->TX  CONTAINS  THE  EDGE  MATRIX  * 

*  SO  ALL  THOSE  PIXEL  '/AU'IS-S  IN  SCAMAT  ARE  MADE  fc  » 

*  FOR  WHICH  THE  CORR* S^OHOI N5  PIXELS  IN  EDGE  AND  » 
»IMA3E  ENHANCED  HATRICER  ARE  NOT  ABOVE  THEIR  RESF-  * 
•ECTIVE  THRESHOLCS.  rMRESHOLCED  PICTURE  IS  PRINTED  » 

INT=0EANH-VAR1 
IE0GE  =  DEAN2*VAF,2 
DO  33  1=2,39 
00  35  J=2,99 

IFCJATKiXd,  J)  «GT.ISr«  ANO,MATRIX(I,J)  .GT.IEDSE)  GOTO  33 
SCAH4T(1,J)  = 

CONTINUE 
CONTINUE 
WRITE  13, NIL 


•  CONNECTEDNESS  rrsT  # 

ICOUNTsf 

00  ezc  1*3,98 

00  81C  J*3,98 
NAROR=C 


IF(SCAt  AT(I,  J)  ,cO,:*')  GOTO  61L 
IF(SCAHAT(I-1, J),EO,-,")  GOTO  821 
NABORsNASOR+l 

IF{SCAHAT(I,J-i).E3,:,')  goto  622 
NA80S  =  NA90R«-1 

IF(SCAMAT(I,  J+1)  ,£0,i,  *•)  SOTO  325 
NAB0R  =  NA90R4-1 


AT  4  O  V  K  r  M  I 


NABO;  =  NAB0R«-1 
IF(NABCR,LE.1)  IC3UNr  =  I00UNT'H 
IF(NA9CF.LE.  1)  SCA M A'’ ( I ,  J)  =u •  0 
CONTINUE 
CONT  INUE 

IFdCOUNT.NE.  ,  )  GOTO  ?31 
WRITE  12, NIL 


FORHATC'l  following  tS  THE  PICTURE  #**,  13 ,  "AFT  ER  COKNESFEONESS  TEST 
CALL  CCGF.AY(BATKIX) 


«no  a» 


♦  SEG1>M^^TI0^^  * 

*  ............  » 


4  44*  ^••^|*4J^^»•**V^,•«»^l•«»«4»♦*•44•»>  *»»444  4»  » 

DO  i.t9  1*1, ll’'" 

00  *'45  J=l,lDr 
HATRIXCI, J)=i 
^45  CONTINUE 
^49  CONTINUE 
NT=fl 

00  699  1*3,38 
00  698  J*3,98 

IF(SCAHAT  (I, J) ,£0. .D^.MATRIX (I, J) .NE.O)  3DT0  898 
IF(MATRIX(I-1, J) .VE.**  GOTO  59? 

IF(HtTKlX(I,  J-1)  .'4£.M  GOTO  695 
NT=NT*1 

MATRIX(I,J)=NT 
GOTO  898 

(J96  MATRIXd,  J)=KATRIX(I,  J-1) 

GOTO  858 

f97  NATRlXd,  J)=MArRlX(I-l,J) 

8  98  CONTINUE 
g99  CONTIN*.  ' 

8  91  NH=3 

00  895  i^  l,lCe 
00  6  94 

IFINATFIXd,  J)  .EC.  S)  GOTO  994 

IF(M«TRIXd,J*l),E9.’.3».‘iaT9IXCI,j4l).E0.M4rRIXd,J))  GOTO  593 
MATRIXd,  J|sMlNO(MAr^rX(T,  J)  ,  MATRIX!  I,  J+D) 

MATRIX (I, J*l)= MAT ^rXfr,J) 

MHaNH+l 

393  IFCMATRIXd,  J-1)  .EG.*  .OR.  •«ATRIX(I,  J-1)  .EQ.HAT  RIX  (I  ,J)  >  GOTO  954 
MATRIX  d,J)=MlN(  (MATUXCr,  J),  MATRIX!  I,  J-D) 

MATFIXil,  J-l)  =  MAT?.IXd,J) 

MH=NH+1 

654  rF!MATRlXd+i,J).EO.'.OR.MflTRIX!l+l,J).EQ.MArRIX!I,J)l  GOTO  994 
MATRIX!!,  J)=MINl  (MAT?  IX  (T,  J) ,  MATRIX!  I +1,J)) 

MATRIX (1*1, J)=MAT?IXf I, J) 

MH*NH+1 

94  CONTINUE 

95  CONTINUE 
IF(NM.NE.C)  GOTO  531 
NT*" 

00  9ii  I*1,19C 
00  899  JaltlCO 
NT*HAX:  (NT,MATRIXd,jn 
89  CONTINUE 
10  CONTINUE 


THINNf'IG 


886 

887 

888 


878 


876 

877 

075 

674 


972 

673 

071 

870 


* 


* 


»  ........  « 

»»»«»*»  »»*  *^*  ****** ******* 

DO  eB8  K-1«MT 
HINI(K)=lfJ 
HINJ(K)-10 j 
MAXl(K)=r 
HAXJ(K)=C 
DO  887  1=1,1"^ 

DO  866  J=lil  ;-2  . .  ..  ..  . 

IF(MATFIX(I,  J)  .NE.K)  GOTO  885 
HINI(K)=MIN5(I,HI«II(<)  » 

MINJ(K)=M1n:-  ( J,MIV«J(<> ) 

HAXI{K)=MAX3 (I,MA<I(<> ) 

HAXJ(K)=MAXS(J,MA<J(<) ) 

CONTINUE 
CONTINUE 
CONTINUE 
DO  8r9  K=1,NT 

IF  (MINI  (K)  .EO.  ILT.O?.  MINJ  (K)  .  £0  •  1^,^! .  OR.HAXI  (  K  )  .EC.  t.  3^.  H  A  X  J  ( K)  . 
♦  E3.1)  GOTO  875 

Nisi 
N2=r 

N3sHINJ(K) 

N4=MAXJ(K) 

DO  8/7  IsN3,Nt- 

IF<MATRIX(HINI (K),I). EC.1)  GOTO  876 
Nl=Nt+l 

lF(MbTMX(NINl  (K)fl,r),E'}.'*)  GOTO  677 
N2=N2*1 

continue 

IF(Nl.GE.N2»  GOTO  37» 

00  675  I=N3,Nt 
HATRIX<MINI(K) ,1) s" 

CONTINUE 

MINI(K)=MINI<K)+1 

GOTO  €78 

N1=C 

N2=f 

00  873  I=N3,N4 

IF(MATFIX(HAX1 (K),I),  EC.")  GOTO  672 
N1=N1*1 

IF<MATriX<MAXI<K)-i,t) ,EC.")  GOTO  873 

N2=N2*1 

CONTINUE 

IF(N1.GE.N2)  GOTO  37’ 

00  871  I=N3,Ni. 

HATRIX(F<AXI(X)  ,1)  sp 
CONTINUE 

MAXI(K)sMAXI(K)-1 

GOTO  874 

Nl= 

N2  = 

N3sMINI(K) 

N4»MAX1(K) 


4 


I  . 
•  - 


7 


eee 

869 

667 

866 


864 

'065 

I 

863 

062 


857 

0  69 
661  _ 


) 


8  55 
8  56 
8  79 


00  «S9  I=K7,Ni 

IPOfftTRlXfliMINJCO).  GOTO  868 

NlsNl+1 

IF(MATFIXCI,MINJU)*l).E0,1>  GOTO  859 

N2sN2*l 

CONTINUE 

IF(N1.GE.N2)  GOTO  36> 

00  8C7  I=NJ,Nt 

MATRIXdiMUlJCO)  =*>  . 

CONTINUE 

MINJ(X)=MIMJ(X)*1 

GOTO  87 C 

N1=C 

N2=f 

DO  865  IsN7,N^ 

lF{NATRIXCI,MtXJ<X)>,E^. *)  GOTO  eSA 
Ni=Nl*l 

lF(K&TFIX(I,MAXJ«»-t)  .EO.”')  GOTO  865 

N2sN2*l 

CONTINUE 

IF(N1.GE.N>J  GOTO  85? 

00  8S3  I=Nl,Nt‘ 

MATRrX(I,NAXJ(K))=j 

CONTINUE 

HAXJ(K)sKAXJ(K)-l 
GOTO  8C6 
N1=KINI(K) 

N2=MAX1(K) 

NSsdNJTK) 

N4*NftXJ(K) 

NP(K)al 

00  861  I=N1,N2 
00  86L  J=N3fNti 

1F<J.EO.N1.0P,I.E3.N?,OR. J,£3.N3,0R. J.EO.N^i  GOTO  657 
GOTO  sec 

IFCMfiTRiXd,  J)  .NE.K)  G0^7  86v 

NP(K)=NP(X)»1 

CONTINUE 

CONTINUE 


*  SI7E  TES’’  * 

*  ....  ....  » 


*************  **jf**^t  0  *m*  m***^*.4  *,****.**nm^** 

ITEST(K)=1 
LENGTH*  (K2-X1)  *i 
I«10THs<NL-NT)  ♦! 

IAREA*( (2»LENGTH)*(?*IHT0TH))*. ,5 
RATIOsFLOATTLENGH)  /- L DAT  ( I WI DT H) 
IFtRATlO.GT.e.  •OR.Rdn.f''..  .125)  ITEST(K)=3 
IF(L£NGTH.LE.2.0F.INnTH,L"«2)  ITEST  (K)aC 
IF(NP<K).LT.IAR£A)ITi5r«)sC 
00  856  I=N1,N? 

00  8i5  J=K3,Nh 

IF(JTEST(K),E9«.)  iArsiXd,  J)sr 

IF(ITEST(K),E'?,1)  *1A*’IX(I,  J)=K 

CONTINUE 

CONTINUE 

CONTINUE 


■IT 


-  «4.4  »»»*••«* 

»  EVERY  TAPSET  IK  THE  '^THSL  PROCESSED  PIC-* 

•  TURE  IS  GIVEN  A  SEPARATE  LETTER  IOENTIF-* 

»  ICATION  AND  THE  ^IJTURE  IS  PRINTED.  * 

DO  8S.8  1=1,1*' 

DO  £‘7  j=i,i:r 

IF(MATRIX(I,  J)  .EO.:)  H^TRIX  (I ,  J)  =  1H 
IF (MATRIX (I, J) .EO.l)  HArRTX (I , J) =iHA 
IFCMATRIXd,  J)  .EP.2>  -^AT^IX  (I  ,  J)  =  iMg 
IF{KATRIX(I,  J).E0.3)  '^A’^RIX  (I ,  J)  =1HC 
IF{MATRIX(I,  J)  .EC.  4)  “^ATRI  X  (I ,  J)  =1H0 
IF{MATP1X(I, J) .EC. 5)  “ATRIX (I , J) =1HE 
IF  (MATRIX  (I,  J)  .£0.6)  HA ’•'^1 X  (I  ,  J )  =1MF 
'IF(MATRIX(I,  J)  .EC.T)  TRI X  (I ,  J)  =1HG 
IF(HATF IX(I, J) .EC.8>  MATRIX (1 ,J) =lhH 
IF(MATRIX(I,  J).£0.9)  MATRIX  (I  ,J>  =  1HI 
IF(MATRIX(I,  J)  .EO,  n»  MA’-RIXd,  J)=1H  J 
IF(MATRIX  (1,  J)  .EC.ll)  MAT  RI  X(I ,  J)  =1HK 
IF(HATRIX(1,  J)  .EC. 12*  MAT »IX(  1,  J)  =1HL 
IF(MATRIX(I,  J)  .EC.  13)  HA^  PIX  ( I ,  J)  =1Hm 
IF(MATRIX  (I,  J)  .EC,  14*  HATt>TX ( I ,  J)  =1HN 
IF(MATRIX(I,  J)  .EC.15*  HA’' X(  I ,  J)  =1H0 
IF(HfcTRIX(I,  J)  .EC. IS)  MA'RIXd,  J)  =  1HP 
IF(MATRIXd,  J).EC,l’*  HA*?!  X(I,  J)  =  1H0 
IF(MATHXd,  J)  .E0.19*  HAT»IX(I,  J)  =  1HR 
I  IF(MATF,IX(I,  J)  ,EC.i9*  MA' =TX(  I,  J)  r  iHS 

'  1F(M,ATK1X<I,  J)  ,£0.2***  -A’OlXd,  J)  =1MT 

.....  IF(MATFIX(I,  J)  .EO. 21*  M  ATPT  X  ( I ,  J)  =  IHU  ... 

IF(MATF,IX(I,  J)  .E0.22*  M  A' X(  1 ,  J)  =H  V 
IF  (MATRIX  (I,  J)  .E0.23*  M A' PT  X ( I ,  J)  =  IHW 
IF (MATRIX (I, J).E0»24*  M A^PT X( I, J) =1HX 
IF(MATF  IXd,J)  .E0.25*  M  A^  P.I X  ( I ,  J)  =1H Y 
g47  CONTINUE 
i?48  CONTINUE 

_  DO  £49  1=1, I*-' 

HATF.IX(I,1)  =  1H7 
MATFlXd,!'  0)  =  1H7 
HATF.IX(1,I}=1H7 
HATRIXd  C,r)  =  lH7 
CONTINUE 
WRITE  2, NIL 

FORMATC’I  FOLLOHISj  is  THP  processed  picture  -#•*,  13) 
00  659  1=1, IPf 

WRITE  858,  (HATRIXd,  J)  ,J=1,  l:C)  , I 
659  CONTINUE 

658  F0PMAT(4X,1C!^  A1,1:X,tT) 

STOP 

END 

r 


SUBROUTINE  TMRESH(  M/V' RIK,  BEAN  ,  VAR) 
DIMENSION  MATRIXCl  •  1i  1  ”) 

OEAN^E 

VAR=r 

DO  8'C  1=3,98 
DO  79f  J=3,98 
DEANsOEAN+MATRIXd,  J) 
gSO  CONTINUE 
790  CONTINUE 

0EAN=0EAN/{95*-*‘2) 

00  75r  1=3,99 
DO  77 u  J=3,98 

VAR=VAR  +  (  (MATRIX  (I,  J>  -9EAN)**2) 

770  CONTINUE 
789  CONTINUE 

VAR=SOf T(VAR/(96*  »2)» 

RETURN 

END 


SUBROUTINE  CCGRAY( 3Ar 
COMMON  SCAMATdH,!’'*) 

DIMENSION  BATRlXdul,  n?) 

DO  Dlt-  1=1* If  •• 

DO  450  J=l,l"f 

IFCSCAMAT  (I,  J)  .GT.  SO  TO  4jl 

BATF.IXd,  J)  =  1H 
GO  TO 

401  IF(SCAMATCI|  J).GT.').  145)  GO  TO  4C  2 
BATFaXd,  J)  =  1H- 

GO  TO  450 

402  IFtSCAMAT  (I,  J)  .GT,a.*?^5»  GOTO  4C3 
BATRlXd,  J>  =  1H= 

GOTO  45  J 

433  IF<SCAMAT  (I,  J)  •GT.’!,  2d  30  TO  4C4 
BATRIXd,  J)=1H* 

GOTO  45' 

404  IF<SCAMATd,  J>  .;T.*  .?t)  GOTO  4t5 
BATRIXd,  J)=1H) 

GOTO  4!  C 

405  IF(SCAMAT(r,J).Gr.n,73)  GOTO  4t6 
BATRIXd,  J)  =  1HI 

GOTO  45: 

406  IF(SCAMAT  (I,  J).Gr.  3.  335)  GOTO  457 
BATRIXd,  J)=1H2 

GOTO  45':' 

407  IF{SCAMAT  (I, J).Gr.1. 41)  GOTO  4C8 
BATRIXd,  J)slHX 

GOTO  45: 

408  IF(SCAHAT{I,J) .01.1.455)  G0T04C9 
BATRIXd,  J)=1HA 

GO  TO  45C 

409  IF(SCAMAT(I, J).Gr.0.49)  GOTO  410 

8ArRIXd,J)  =  lHM 
GO  TO  45r 

410  BATRIXd,  J)  =  1H0 
45C  CONTINUE 

WRITE  Si.r,  (BATRIXd,  J)  ,  J=l,l.  4)  ,I 
930-  FORKAT<lH,l?r Ai,i:x,r2) 

00  42i  K=l,  1.  ■ 

IF(SCAMAT(I,K).Gr.l.41)  GOTO  411 
BATRIX  dfOslH 
GOTO  4  2C 

411  IF(SCAMAT(I,K).Gr.1,  G45)  GOTO  412 
BATRIXd, X)=1H- 

GOTO  42:' 

412  IF(SCAMATd,K),Gr,3.5'))  GOTO  413 

BATRIXd, <)  =  1H= 

GOTO  4  2C 

413  IFCSCAMAT  djO.GT.I.  3?)  GOTO  ^14 

BATRIXd, <)  =  1H+ 

GOTO  tz*! 

414  BATRIXd, <)=1HX 
420  CONTINUE 

WRITE  ■51  (5ATFlX{[,<),'<=l,l.;r) 

915  FORfrAT  (IW*,  i.  Al) 


00  «v3C  L*l»iCC‘ 

IF(SCAPAT(I»L).GT,1.5?)  SOTO  i*21 
BATMX(I,L>  =  1H 
GO  TO  A3r. 

BAT^:IX<I,L)  =  1H* 
l»30  CONTINUE 

WRITE  91.',(5ATRIX{t,L),L  =  l,l.  C) 

DO  *!«tC  H=i,12( 

IF<SCAHATa,M).Gr.'*.  GOTO  A31 

8ATRIX(I,N|=1H 
GO  TO  AAC 

l|3i  BAT?IX<I,N»slH. 

440  CONTINUE 

WRITE  SIT',  (9ATRIX{t,'1),‘»=l,l'  r) 

00  AfcC  N=i,i'‘(: 

IF(SCANAT(1,N) .ST .Si)  GOTO  A41 

SArRlX(I,N)=lH 

GOTO  AGt 

441  IF(SCA«AT<I,N).Gr.  32)  GOTO  4^2 
BATRIX  (1,N)  =  1H= 

GOTO  46 T 

442  IF(SCAMAT(I,N)  .GT.T.  ?7)  GOTO  <*43 
BATRIX(I,N)=1H- 

GOTC  4€  : 

443  BATUXd,  fi)  slHH 

460  CONTINUE 

WRIT  £91,  ,  (9ATF.IX(I,'I)  ,N=1,  li  5) 

DO  A7C  INsl,lv!.i 

IF  <SCANAT(I,IN),Gr.%i’)  GOTO  451 
8ATRIX(I,IN)  =  1H 
GOTO 

451  IF(SCAMAT  (I,IN).;T.’.A1)  GOTO  <*62 
BATciXdjINJriHC 

GOTO  47 r 

452  BATRIX(I,IN) S1H3 

470  CONTINUE 

WRITE  9ir ,(BATRI*(I,TN>,IN=l,iCC) 

00  46:  NN-t,!'^': 

IF(SCAMAT(I,HN)  .U.' .9?)  GOTO  461 
BATRIX(I,NN)  =  1H 
GOTO  4ec 

461  8ATRIXd,NN)=lHV 
463  CONTINUE 

WRITE  Slf  f  (RATRIKd,  NN)  ,  NN  =  1 ,  it  ^ ) 

00  49''.  NHsltlir 

IF<SCAMATa,MN).GT,  .939)  GOTO  471 
0ATRIX<I,'1N)=1H 
GOTO  4  9: 

471  BATRIXd,f<N)--lHA 
490  CONTINUE 

WRITE  91f  ,  (BATPiXd,  “M)  ,  MNsl  ,lf  <:) 
590  CONTINUE 
RETUNN 
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